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DETAILED ACTION 
Response to Arguments 

Applicant's arguments filed 9/10/07 have been fully considered but they are not 
persuasive. 

Page 9, paragraph beginning with "It is not seen": 

The applicant argues that the teachings of Tsai, when combined with Graves, do 
not suggest the hierarchical features disclosed in the claim. Graves (figure 8; column 6, 
lines 17-39) discloses a system using a neural network with multiple hierarchical levels 
used to determine user recommended programming. As admitted by the examiner, 
Graves does not disclose a system wherein a type of bypass can be used to output a 
decision made at an earlier level to avoid analyzing the data at each level of the neural 
network. Tsai (Abstract) teaches a system, which uses a neural network to test data at 
different levels to see if image recognition can be performed. Although both inventions 
do not disclose a system testing the same type of data, it would have been obvious for 
one of ordinary skill in the art to see that systems using neural networks to perform data 
recognition (either on user preferences or images) could share techniques for 
performing their respective functions. Referring to the cited portion of Tsai (column 4, 
lines 10-17), this section teaches the idea that a decision could be made at a lower level 
if a threshold is met, and if the threshold is not met to continue on through the levels 
until the threshold is met. As both Graves and Tsai teach systems using hierarchal 
neural networks to make decisions, it does not seem to be a large leap in thought to use 
the level bypassing feature taught by Tsai in the system disclosed by Graves. 
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In response to applicant's argument that the examiner's conclusion of 
obviousness is based upon improper hindsight reasoning, it must be recognized that 
any judgment on obviousness is in a sense necessarily a reconstruction based upon 
hindsight reasoning. But so long as it takes into account only knowledge which was 
within the level of ordinary skill at the time the claimed invention was made, and does 
not include knowledge gleaned only from the applicant's disclosure, such a 
reconstruction is proper. See In re McLaughlin, 443 F.2d 1392, 170 USPQ 209 (CCPA 
1971). Specifically, the motivation of providing a result at an earlier time than would 
have previously been available is a valid motivation as time is always an issue when it 
comes to consumer electronics. The less a customer has to wait for something to 
happen, the more likely the customer will be to use that feature and the more likely 
other people will be likely to purchase the product. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1. Claims 1-3, 5-8, 14, 15, 17, 19 and 20 are rejected under 35 U.S.C. 103(a) as 

being unpatentable over Graves in view of Tsai. 

Referring to claim 1, Graves discloses a method for providing hierarchical 

decision fusion of recommender scores, said method comprising the steps of: 
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(a) providing a plurality of recommenders at a first level, said recommenders 
being grouped to at least one of a plurality of predetermined groups (column 8, lines 52- 
55); 

(b) providing a predetermined number of first level fusion centers for receiving an 
output from each of said recommenders from at least one particular group (figure 8, 
lines going into part 48); 

(c) outputting a decision by each one of said plurality of recommenders grouped 
in step (a) to a respective first level fusion center, wherein each decision provides a 
recommendation (figure 8, lines going from part 48 to 50); 

(d) each respective first level fusion center performing a first fusing step of the 
decisions output in step (c) by said recommenders from said at least one particular 
group (figure 8, part 50); 

(e) each respective first level fusion center outputting a first enhanced decision 
based on the fusion performed in step (d) (figure 8, lines going from part 50 to 52); 

(f) providing a plurality of second level fusion centers for receiving the first 
enhanced decisions output from a group of said first level fusion centers (figure 8, part 
52); 

(g) each respective second level fusion center performing a second fusing step of 
the first enhanced decisions received from the group of said first level fusion centers 
(figure 8, part 52); 

(h) each respective second level fusion center outputting a second enhanced 
decision (figure 8, part GRADE); and 
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(i) outputting to a user a finally enhanced decision chosen from the enhanced 
decisions in step (h) (column 2, lines 23-25). 

Graves does not disclose a method wherein step (f) is preformed if the first 
enhanced decisions are not within a predefined range, and otherwise outputting to a 
user a finally enhanced decision chosen from the enhanced decisions at step (e). 

In an analogous art, Tsai teaches a method wherein step (f) is preformed if the 
first enhanced decisions are not within a predefined range, and otherwise outputting to 
a user a finally enhanced decision chosen from the enhanced decisions at step (e) 
(figure 8; column 4, lines 10-17). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add the predefined range step taught by Tsai to the method disclosed by 
Graves. The motivation would have been to enable the result to be available sooner, as 
it would only pass through the first level of logic. 

Referring to claim 2, Graves discloses a method according to Claim 1, wherein 
the plurality of recommenders provided in step (a) have overlapping topics of interest 
(figure 3; Note: Each of the categories could describe features of the same television 
program or movie, and therefore are considered to have overlapping topics of interest.). 

Referring to claim 3, Graves discloses a method according to Claim 2, wherein 
the user's profile contains a plurality of preferences previously recorded (column 8, lines 
52-55). 
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Referring to claim 5, Graves discloses a method according to Claim 1, wherein 
the first fusing step recited in step (d) is performed by one of weighted average, voting, 
neural network (column 6, lines 24-26), and Dempster- Shaffer Evidential Reasoning. 

Referring to claim 6, Graves discloses a method according to Claim 1, wherein 
the second fusing step recited in step (g) is performed by one of weighted average, 
voting, neural network (column 6, lines 24-26), and Dempster-Shaffer Evidential 
Reasoning. 

Referring to claim 7, Graves discloses a method according to Claim 1, wherein 
step (h) further comprises (i) providing a plurality of third level fusion centers for 
receiving the second enhanced decisions from the second level of fusion centers, and 
(ii) each of the plurality of third level fusion centers performing a third fusing step of a 
predetermined number of second enhanced decisions (column 6, lines 30-39). 

Claim 8 is rejected on the same grounds as claim 7. 

Referring to claim 14, Graves discloses a method according to Claim 11, wherein 
the finally enhanced step is output to the user via one of wire communication (figure 1 , 
line going from part 17 to 20), wireless communication, fiber optics, LAN/WAN, and 
Internet. 



Application/Control Number: 10/029,830 Page 7 

Art Unit: 2623 

Referring to claim 15, Graves discloses a system for hierarchical decision fusion 
of recommender scores, said system comprising: 
a central processing unit (figure 2, part 28a); 

a memory in communication with said central processing unit (figure 2, part 32a); 

a recommender module comprising fusion software for fusing recommendations 
of a predetermined number of groups (figure 1, part 17); 

means for outputting a recommendation to a user (column 2, lines 23-25); 

wherein said recommender module provides at least two levels of fusion (figure 
8), wherein a plurality of recommendations are fused at a first level to provide a plurality 
of first enhanced decisions (figure 8, part 50), and said plurality of first enhanced 
decision are fused at a second level to provide a plurality of second enhanced decisions 
which are fewer in number than said first enhanced decisions (figure 8, part 52). 

Graves does not disclose a method wherein second step is preformed if the first 
enhanced decisions are not within a predefined range, and otherwise outputting to a 
user a finally enhanced decision chosen from the enhanced decisions at the first step. 

In an analogous art, Tsai teaches a method wherein second step is preformed if 
the first enhanced decisions are not within a predefined range, and otherwise outputting 
to a user a finally enhanced decision chosen from the enhanced decisions at the first 
step (figure 8; column 4, lines 10-17). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add the predefined range step taught by Tsai to the method disclosed by 
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Graves. The motivation would have been to enable the result to be available sooner, as 
it would only pass through the first level of logic. 

Claim 17 is rejected on the same grounds as claim 14. 

Referring to claim 19, Graves discloses a system according to Claim 15, wherein 
said means for outputting a recommendation to a user includes a display (figure 1, part 
22a). 

Referring to claim 20, Graves discloses a system according to Claim 15, wherein 
said system includes means for storing a cookie on a user's storage device, said cookie 
containing an identifier of a user profile in said memory (column 8, lines 52-55). 

2. Claims 4 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Graves in view of Tsai as applied to the claims above, and further in view of Gill. 

Referring to claim 4, Graves and Tsai do not disclose a method according to 
Claim 3, wherein the previously recorded preferences comprise one of a viewing 
history, listening history, and literary history. 

In an analogous art, Gill teaches a method according to Claim 3, wherein the 
previously recorded preferences comprise one of a viewing history (figure 11, box 195), 
listening history, and literary history. 
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At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add viewing history to the items considered, as taught by Gill, in the program 
selecting method disclosed by Graves and Tsai. The motivation would have been to 
provide more information to the neural network, therefore making the output more 
accurate and more useful to the user. 

Claim 16 is rejected on the same grounds as claim 4. 

3. Claims 9-11, and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Graves in view of Tsai as applied to the claims above, and further in view of Yeh. 

Referring to claim 9, Graves and Tsai do not disclose a method according to 
Claim 7, wherein step (h) further comprises (iii) providing a single nth level fusion 
center, n being an integer greater than 3, said nth level fusion center receiving decisions 
output from said second level of fusion centers; and (iv) providing an nth fusing step 
from the second enhanced decisions. 

In an analogous art, Yeh teaches a method according to Claim 7, wherein step 
(h) further comprises (iii) providing a single nth level fusion center, n being an integer 
greater than 3, said nth level fusion center receiving decisions output from said second 
level effusion centers; and (iv) providing an nth fusing step from the second enhanced 
decisions (figure 8). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add hidden levels to the neural network, as taught by Yeh, to the method 
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disclosed by Graves and Tsai. The motivation would have been to allow the process to 
be more accurate. 

Claim 10 is rejected on the same grounds as claim 9. 

Referring to claim 11, Graves and Tsai do not disclose a method according to 
Claim 9, wherein the nth level of fusion centers is a fourth level. 

In an analogous art, Yeh teaches a method according to Claim 9, wherein the nth 
level of fusion centers is a fourth level (figure 8, column 11, lines 26-28). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add hidden levels to the neural network, as taught by Yeh, to the method 
disclosed by Graves and Tsai. The motivation would have been to allow the process to 
be more accurate. 

Referring to claim 1 3, Graves and Tsai do not disclose a method according to 
Claim 1 1, wherein the nth fusion step is performed by one of weighted average, voting, 
neural network, and Dempster-shaffer Evidential Reasoning. 

In an analogous art, Yeh teaches a method according to Claim 11, wherein the 
nth fusion step is performed by one of weighted average, voting, neural network (figure 
8, column 11, lines 26-28), and Dempster-shaffer Evidential Reasoning. 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add hidden levels to the neural network, as taught by Yeh, to the method 
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disclosed by Graves and Tsai. The motivation would have been to allow the process to 
be more accurate. 

Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Graves 
in view of Tsai as applied to the claims above, and further in view of Inoue. 

Referring to claim 12, Graves and Tsai do not disclose a method according to 
Claim 8, further comprising providing a single nth level fusion center, n being an integer 
greater than 4, said nth level fusion center receiving decisions from a plurality of n-1 
level fusion centers, wherein said n-1 level fusion centers being a higher level than the 
third level of fusion centers. 

In an analogous art, Inoue teaches a method according to Claim 8, further 
comprising providing a single nth level fusion center, n being an integer greater than 4, 
said nth level fusion center receiving decisions from a plurality of n-1 level fusion 
centers, wherein said n-1 level fusion centers being a higher level than the third level of 
fusion centers (figure 5). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add hidden levels to the neural network, as taught by Inoue, to the method 
disclosed by Graves and Tsai. The motivation would have been to allow the process to 
be more accurate. 

Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Graves 
in view of Tsai as applied to the claims above, and further in view of Yuen. 
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Referring to claim 18, Graves and Tsai do not disclose a system according to 
Claim 15, wherein memory comprises a network server. 

In an analogous art, Yuen teaches a system according to Claim 15, wherein 
memory comprises a network server (figure 1 1 , part 350). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to move the neural network to a network server, as taught by Yuen. The 
motivation would have been to enable the user set top boxes to be simpler by doing the 
calculations on the server. 

Claim 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over Graves 
in view of Tsai as applied to the claims above, and further in view of Kim. 

Referring to claim 21, Graves and Tsai do not disclose a system according to 
Claim 19, wherein the display resides in a remote control. 

In an analogous art, Kim teaches a system according to Claim 19, wherein the 
display resides in a remote control (paragraph 46, lines 1-3). 

At the time of the invention it would have been obvious for one of ordinary skill in 
the art to add the remote viewer, taught by Kim, to the system disclosed by Graves and 
Tsai. The motivation would have been to allow the user to view the recommendations 
without interrupting the display of video on the television. 
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Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Justin E. Shepard whose telephone number is (571) 
272-5967. The examiner can normally be reached on 7:30-5 M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Kelley can be reached on (571) 272-7331. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



JS 




